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bandwidth) amongst users. It is also desirable to be able to provide different levels of 
service to different users. This, in consequence, means that network resources must 
usually be shared unequally between users to provide different levels of service. 

Once it is accepted that different users will receive different allocations of resources, it 
then becomes necessary to provide a mechanism which allows interaction between 
users. Such required interaction can make resource control systems computationally 
complex and also limit the ability of a network operator to introduce new resource 
control systems on a piecemeal basis. 

The present invention sets out to produce a relatively simple mechanism for allocating 
resources to users in a network and a mechanism which is stateable and does not V 
need to be implemented on a network-wide basis. 

SUMMARY OF THE INVENTION 

In accordance with a first aspect of the invention there is provided a method of 
managing resources in a switched network comprising the steps of assigning a 
respective WtP value to each of a plurality of network users, assigning respective set 
point values for a network performance parameter for each of a plurality of routers in 
the netWrk,~asslgrfingTrespe^^ router which is associated 

with the network performance parameter at the router, and operating a first control loop 
which is operable to receive respective measures of the actual network performance at 
each of the routers, calculate for each router, a plurality of difference values which are ; 
the respective differences between the actual performance and the set point lor each 



router, adjust the price value fo- ^ch router by a factor based 'on 'ifc respective^ 
difference value, generate a fkw^pr^j<Bltofo^ 
for each of the routers in the patt ed 

network, allocate a resource sham viahie tor, each tt^ V<l|^>^ 
5 the respective WtP value divided 

ingress router for each user to; re>^c|^ network ingress from each user $ 

accordance with each user's allocated resource share- value, wharehy thn 
network performance at each router is made to converge 1b the set point value fe^ffie:^ 
respective router by automatic admission control adjustments at the network ingress i 
10 routers. 

Preferably the method also Includes assigning respective second an point values for a 
second network performance parameter for each of a plurality of routers in the network, 
assigning a respective initial second price value to each router whica is associated with 
15 the second network performance parameter at the router, and further including 
operating a service manager operable to monitor the said convenience of the actual 
network performance with the set point network performance and to provide a 
provisioning potential value to a second control loop, the second control loop being 1 
operable to receive respective measures of the actual second network performance 
20 parameter at each of the routers, calculate for each router, a plurality of difference 
values which are the respective differences between the actuEii second network 
performance parameter and the second set point for each router, adjust the second 
price value for each router by a factor based on the respective! difference value, 
generate a second flow price value for each user by summing the second price values 
25 for each of the routers in the path of the respective user's desired da ta flow through the 
network, and allocate a second resource share value for each user which represents 
the value of the respective provisioning potential value divided by the respective 
second flow price value, the Ingress router for each user being cau sed to restrict flow 
into the network ingress from each user in accordance with each user's first and 
30 second allocated resource share values, whereby the actual network performance at 
each router is made to converge to the first and second set point values for the 
respective router by automatic admission control adjustments at ths network ingress 



routers. 
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In this way, it is possible to 
network control loop. Thus in fiih^ 
commodity market and the operator 
example, the user network control loop may 

delay), and the operator network control loop rnay oj^rate to allocate ban&width 
resource amongst users. As described below; these set points and the values of the 
willingness to pay and provisioning potential values may be set in accordance with 
policies which may in turn may be related to service level agreements between users 
and network operators. 



In a second aspect of the invention, there is provided admission control apparatus tor a 
switched network having a plurality of routers, the apparatus arranged to record a 
predetermined respective WtP value for each of a plurality of network users, each of 
the users being coupled to the network via an ingress router, record respective 
15 predetermined set point values for a network performance parameter for each of a 

! 

plurality of routers in the network, and to assign a respective initial price value to each 
router which is associated with the network performance paramete r at the router, and 
the apparatus comprising loop control means operable to receive n^specfive measures 
of actual network performance at each of the routers, calculate for each router, a 

20 plurality of difference values which are the respective differences between the actual 
performance and the predetermined set point tor each roiAer, adjust the price value for 
each router by a predetermined factor based on the respective difference value, 
generate a flow price value for each user of the network by summing the price values 
for each of the routers in the path of the respective user's desired data flow through the 

25 network, allocate a resource share value for each user which repnasents the value of 
the respective WtP value divided by the respective flow price value, and cause the 
Ingress router for each user to restrict flow into the network ingresn from each user in 
accordance with each user's allocated resource share value, whereby the actual 
network performance at each router is made to converge to the set point value for the 

30 respective router by automatic admission control adjustments at the network ingress 
router. 



In a further aspect, there is provided computer software whidn when executed, 
operates to manage resources in a switched network by performing the steps of 
35 assigning a respective WtP value to each of a plurality of network users, assigning : 




respective set point values for $ i 
of routers in the network, 
is associated with the network petffo^^ 
first control loop which is operable htb receive respective measures -of l-lbttMA^cU^ 
5 network performance at each of the routers, calculate for each rotifer* a plurality 6f p 
difference values which are the respective diff 

and the set point for each router, adjust the price value for each muter by a factor 
based on the respective difference value, generate a flow prioa value for each user by 
summing the price values for each of the routers in the path of the respective us*^s 

10 desired data flow through the network, allocate a resource share value for each user 
which represents the value of the respective WtP value divided by the respective flow 
price value, and cause the ingress router for each user to restrict flow into the network 
ingress from each user in accordance with each user's allocated resource share value, 
whereby the actual network performance at each router & made to converge to the set: 

15 point value for the respective router by automatic admission control adjustments at the 
network ingress routers. 



The invention also provides in another aspect dynamic resource control network in 
which a network operator controlled entity, rather than the user itself, determines 
20 willingness to pay associated with user traffic, responsive to resource pricing 
information provided from traffic routing nodes in said network. 



In another aspect, the invention provides a method of managing t\ dynamic resource 
control network wherein a network operator controlled entity, rattier than the user itself, 
25 determines willingness to pay associated with user traffic, respixisive to resource! 
pricing information provided from traffic routing nodes in said network. 

In an additional aspect, the invention provides software on a machine readable medium 
for managing a dynamic resource control network wherein a network operator 
30 controlled entity, rather than the user itself, determines willingness to pay associated 
with user traffic, responsive to resource pricing information provided from traffic routing 
nodes in said network. 
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it will be appreciated that the term "user" as used hereto includes an aggregate of 
users. 




The preferred features may be a>mbtoed as appropriate* as would be apparent to a 
skilled person, and may be combined with any of the aspects of ttte ^ \ - 

5 BRIEF DESCRIPTION OF THE DRAWINGS 

in order to show how the invention may be carried into effect, €trnbodiments of ; t^ 
invention are now described below by way of example only and vvith reference to' = 
accompanying figures in which: ! i // ^"1- 

10 Figure 1 shows a general schematic diagram of a resource control system^ iri V 
accordance with the present invention; 

Figure 2 shows an example of resource utilisation In accordance ywith the present 
invention; 

Rgure 3 shows a schematic diagram of a system to accordance with the present 
15 invention; 

Rgure 4 shows a screen capture of a demonstration network of Figure 4; 

Figure 5 shows a more detailed nodes of the network of Figure 4; 

Figure 6 shows a graphical representation of simulation results for the network of 

Figure 4; 

20 Figure 7(a-b) shows a graphical representation of a system in aixxwdanca with the 
present invention; 

Figure 8 is a schematic block diagram of a network having three users and in which 
resource control is controlled by two control loops; 
Figure 9 Is a schematic block diagram of the control loops of Figure 8; and 
25 Rgure 1 0 is a shcematic block diagram of the network of Figure 8 including the control 
loops. ! 

DETAILED DESCRIPTION OF INVENTION 

30 The following features can be observed when trying to devise parajieis between a 
general control system mechanism and network operator/user-aggregate system: 



There is a set point at which the system wishes to hold the output 
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• In general, a control system tries to hold the output level of the system at that specified 
set point. 

The system achieves this by increasing or decreasing, for example, an intermediate 
5 variable in a feed back loop. 

If there are multiple components sharing the output, all those components get treated 
in an even manner, in a general case. 

10 In the network operator/user-aggregate scenario, this is equivalent to: 

The operator wants to set a control level for each class of traffic such that isolation 
between classes are maintained. 

15 The operator would wish that the control level kept is maintained, in other words the 
given supply is fully consumed. 

The intermediate variable is manipulated according to the difference between the 
supply and how much it is consumed (in other words the demand). This variable is 
20 usually termed as the resource price. This resource price works as a forcing function 
that drives an economic system. 

There are always multiple user-aggregates sharing the resource and an even treatment 
to all of them ensures a particular form of fairness known as proportional fairness. 

25 

The general construction of the exemplary system is shown in Figure 1. A more 
specific example with multiple resources and users will be described below. In Figure 
1, the parameters are defined as follows; 



30 C k Set point for control, resource unit 

E k Difference variable 

k Sample step number 

K k Gain parameter 

P k Resource price, price unit for resource unit 

35 PP k Potential willingness to Pay by the user, Potential willingness to pay unit 



♦ * 
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* Y k Output level, resource unit 

(Notes: (1) C kl K k , PP k etc need not vary for sample steps. (2) The resource price unit 
could be expressed as price unit per unit resource if the resource price is divided by the 
5 resource capacity. But then again this has to be rectified later in the ensuing 
calculations. Hence this is avoided.). 

The difference between the set point and controlled output is given by 
E k = C k — Y k 

10 

This difference is multiplied by a gain factor and fed to the resource pricing block. 

As the consumption of resource increases, the resource price must go higher and vice 

versa. 

15 Hence this gain-difference product is given as a negative input to the pricing block. 

The resource price is later used as the denominator for calculating resource 
consumption. Here it works, for example, as the price to use a common facility (The 
numerator is the potential willingness to pay). 

20 An initial resource price condition (P0) is forced on the system and is taken as unity. 

The resource price is also bounded to upper and lower limits so as to define an 
operating regime. 

The output of the pricing block is given by 
25 P k +1 =P k -K k E k 

The output level Yk is now calculated as 
Y k +i = PP k +i / P k +i 

This is now fed back for sustained operation. 

Multiple resources and user aggregates using different paths: 
30 This is the usual scenario. 

Let the total number of resources be RT and the total number of user aggregates be 

NT (active paths). Then the parameters of interest modifies to incorporate the different 

sets of resources, user aggregates and paths: 

C Rk Set point for control for resource R 

35 E Rk Difference variable for resource R 
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* K Rk Gain parameter for resource R 

N T Number of user aggregates (active paths) 

P N k Total resource price for user aggregate N 

P Rk Resource price for resource R 

5 R T Number of resources 

U N Resource consumption by user aggregate N (eg. Flow rate of active 
path) 

V T Number of paths (or combinations) 

PP Nk Potential willingness to Pay by the user aggregate N 

10 Y Rk Output level of resource R 

R N Resource subset used by user aggregate N 

N R User aggregate using resource subset R 



The equations become: 

Eri< = Crk — Yri< 

15 P Rk +i = P Rk — K Rk E Rk 

If there are N T user aggregates using these resources in V T paths the resource price for 
each user aggregate is calculated as: 
Pni<+i = ZP Rk +i, R g Rn 

The resource consumed by user aggregate N is given by: 

20 U Nk+1 ~ PPNk+1 / PNk+1 

The output level is now given as: 
Y Rk+ i = IU Nk+1 , NgN r 

This summation is an automatic result of resource consumption by different users. This 
value is now fed back for sustained operation. 
25 Scalability: This suggests that the system above is scalable to multiple layers of 
hierarchies. 

Multiple users contributing to a user aggregate: 
This subsection is included for completeness. 



N T Total number of user aggregates 

30 P Nk Total resource price for user aggregate N 

U N Resource consumption by user aggregate N 

V T Total number of paths 

PP Nk Potential willingness to Pay by the user aggregate N 

n Number of users making N user aggregates 

35 P nk Price for individual user making up total aggregate resource price PNk 
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* u n User resource consumption making up aggregate consumption UN 

v Number of individual paths making V aggregate paths 

PP nk Potential willingness to Pay by user making up aggregate PPNk 

N g n 
5 P Nk = I P nk 

U N G U n 
V G V 

PP Nk = I PP nk 

The operation at this level is mainly decided by the business policy. It may be defined 
10 by how individual SLAs are made, how the utilities are assessed and distributed and/or 
how the individuals are charged. 

P Nk and PP Nk are parameters in the carrier network level for user aggregates. How 
these are distributed and mapped to the real world customer relations/economics is a 
15 subject matter not dealt in this paper. It could be a linear or non-linear relationship as 
decided by various policies. 

An implementation of the principles outlined has been performed on a real network. 
This used a cluster of Linux routers and a set of distributed flows. The model for 
20 demonstration uses three ingress routers, two core routers and four traffic sources for 
generating flows and for introducing disturbance to the network. The model uses a 
distributed three flows scheme. 



This model is sufficient to demonstrate the principles and allows the study of 
25 interactions between the three component flows. 

The lab model for implementation was devised to be compliant with the COPS 
(Common Open Policy Server) Resource Broker model as shown: 

30 The user policies to be implemented are stored in the Policy Information Base (PIB). 
The implementation decisions are made at the Policy Decision Point (PDP). These 
policies are then enforced at the Policy Enforcement Points (PEP). The network 
topology and measurement information is stored and collected at the Network 
Information Base (NIB). The benefit to user and revenue to network operator are 

35 displayed at the Benefit/Revenue Meter (BRM). 



* 
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The network is designed around a set of Linux routers and traffic scwirces and sinks. \ r % | 



Routers 2a and 2h form the core network. These are the system resources. The output 
bandwidth (resource utilisation) of these rbuters is set at a specifier] level (in this case 
6Mbps). The output bandwidth of these routers is to be measured. To achieve this per 
15 class of traffic, the diffserv CBQ is attached to their output ports as well. The 
measurement is done through the tc command interface. The {statistics command 
provide the measurement. 



20 is sunk at the input port of 2h. The ingress controller is 1 b. 

Flow2: Host 2g provides a TCP traffic that uses both resources 2a and 2h. The sink is 
1d. The ingress controller is 2c. 

25 Flow3; Host 1h provides a UDP source that uses resource 2h only. The sink is 1d 
again. The ingress controller is 1c. 

Disturbance: Host 3g is used to generate a traffic pulse so as to create an overflow at 
the core routers, to study the performance and demonstrate the ef fect Two flows are: 
30 generated: D1, that uses both resources and terminates at 1d and D2 that uses only 
one resource (2a) and terminates at 2h. 

The communication interface is at the moment done through scth (secured shell) 
access and is planned to be done via remote invocations in the future 



FIowl: Host 1e provides a UDP traffic source that uses cxw?e router 2a only. The output 
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Advantageously the software Is implemented in ailtytft^p&i^ 
prototyping. ><: •;. -.-/:■! 

' : . ... , : : - • . ; . '': f ; r •''.•!•■: ;'v" 

Only one class of traffic is used in the pr*^^ 
5 understood that the system couldi^:jUMd4br anyjola^^'ttafllc./ ''^l^K-;^ 

As described earlier, there are threejj*^^ 

shares resouroel, user2 shares both resourcet and re^purccfi and usera ^^ 
resource2. 

10 

At start up the system allocates the bandwidth for these user aggregates using an 
initial price. This decision is made at the POP using the algorithm. The bandwidth at the 
resource outputs are now sensed and fed back. This informatMMi is collected at the 
Network Information Base. The algorithm then modifies the allocated bandwidth so as 
15 to force optimum utilisation. This is achieved by varying the intemrediate variable that is 
the resource price. The steady state is reached in two sample steps. In the current 
implementation the time step is about one second. 

The graphs on the screen capture shown above (Fig 4) shouts the network load 
20 measured via SNMP daemons. The scales have been modified to give better visibility 
and represent about 50 seconds on the x-axis, 

The graph on the left-hand-top (S1) shows the UDP traffic generated. The second 
graph on the same line (11) shows the controlled output The dip in the flow la due to 
25 the effect of the disturbance that increases the resource usage suddenly. The 
disturbance flow can be seen in the lower middle (D1). It may be observed that the 
excess UDP flow gets dropped at the Ingress router. A mechanism may be employed 
to signal packet drops back to the user for the user to take corrective measures, 
Increasing user Potential willingness to pay, 

30 

The lower left-hand graph (S2) shows the TCP flow that is fnpu: to the system. The 
second graph on the line (12) shows the controlled flow. It Is interesting to note th^t the 
TCP flow varies itself at the source, since the TCP works underneath the control 
provided by the system. This can be called TCP trunking and may find great 
35 commercial applications because the network operator can provide preferential 
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treatment to specific edgeniifferent^te^ user fkiw aggre<^ 

heterogenous network, TCP delays inlthe co^e are not uneojnnicrth As #ie ■ 

performed at the Ingress, these dei^ ^ ivoWed- This basically 

performance can greatly be imprw€^ Ifime^ w 

5 ' .:,;/ : ,0: .i ' , ' \ f ■ . :^\- : [-%-- 

The lower graph on the right-hand side? (13) shows anci^ qc^i^sd XipP f|ow t y 

input to the system. ; ! • ; ^ 

The two graphs on the top right-hand k^te (Gtj^ 
10 routers. The sudden rise is due to the disturbance pulse. The bandwidth can be sew tb' 
be controlled back to the set point very fast The time delays are due to the various 
time lags in the network and system implementation which at fr e moment are not 
attended to. 

15 It can be seen that the disturbance affects all the ingress controllers. This Is because 
the disturbance flow passes through both resources. If only one resource is disturbed, 
only the respective resources will be affected. This win reiterate the fact that the 
calculation is not depending on global knowledge. A screen capture of this is not 
included, to save space. (This scenario is better understood in the analysis part where 

20 one can see interactions between various components. This in explained in the 
simulation section). 

An exact model of the demonstration system described above is given above. The 
various constituent blocks are explained 

25 

There are two resources with two settable control levels and three users and flows 
taking three routes. 

The ingress controller determines the resource prices per useracjgregate path. The 
30 controlled flows get combined in the core routers. As a consequtmoe the system is 
inherently distributable and scalable. 



Simulation: 

Results of a matlab simulation are shown in Figure 6. 
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(Plots Flowl, Flow2 & Flow3 (xwresponds tofitetB rii^j&©i^tt!i4?^^^ 

4). The disturbance flow used is D2,;not©1(ref: F]g2)>; r = : - i ; 

Explanation:' . jV. : l- : \ ' • ■ '\ (.].]■ £y :: y\ :{:'■}, '„•;. 

_ _ ,_ stept: Atstepl the program state. up; jv - l ; ^ '• 'ii'uj -'/•'• 

5 The initial price is unity and PP for all users is set at 3 urnto per unit bamMdth 

From given equations: 

The resource price for each user is 

PN1[1] = PR1[1]-1 

PN2[1] = PR1[1] + PR2[1J - 2 
O 10 PN3I1] = PR2[1] - 1 

IfJ The flow allocated to each user is 

$ UNl[1] = PPN1[1]/PN1[1]-3 

g UN2[1] = PPN2[1]/PN2{1] = 1.5 

S UN3[1] = PPN3[1]/PN3[1] = 3 

m 15 The total output at the resources is 

|\ YR1[11 = UN1[11 + UN2[11 = 4.5 

fU YR2I1] = UN2[1] + UN3{11 = 4.5 

fy Step2: The above usage information is now fed back to tte controller. 

= The error signals are 

O 20 ER1[1] = CR1t1]-YR1[1] = 1-5 

ER2[1] = CR2t1] - YR2[11 ~ 1.5 

The system how updates the resource prices as 

PR1[2] = PR1[1]- KR1[1]ER1[1] = 0.76» KR1 = 0.16 

PR2[2] = PR2[1] - KR2[1JER2[11 = 0.76, KR2 « 0.16 
25 The resource prices for Individual users is 

PNIp) - PR1J1] = 0.76 

PN2|2) = PR1[2] + PR2[2] =1.52 

PN3t2] - PR2[2] = 0.76 

The flow allocated to each user Is 
30 UN1[2] = PPN1P]/PN1[2J = 4 

UN2[2] » PPN2P] / PN2f2] » 2 

UN3[2] = PPN3I2] / PN3[2J = 4 
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The total output at the resources is 
YR1[2] = UN1 [21 + UN2[2] = 6 
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VR2[2l = UN2[2] + UN3[2] * 6 

Features of importance: , ,, 

When the system senses that the demand is less than supp^ the price* te-itidueati^ ^ 

that the reswrora_are_tul_ly utfRseoV _ _ C \_ ^:-( h ._J __, ^p^o;,* 

5 Comparing the utilisation of the n^od^j^^^mf §fflptk&S: ; ^ ^ i.,; % 

YR1I1]- 4.5 units ; '. f \>| 

YR2I1] = 4.5 units ' ' vH'& J • . - '^'.V. ' 

YR1I2]=6units ; . 'H" ' ' T%V¥> 

YR2[2]-6units • '•: 

10 There is 33% Increase in the usage (here Haw). 

. Thus the network gets its set control capacity fully utilised. 
For any resource, for a given sum of PPs, the product of total resource usage and 
resource price remains same In both atepl and step2 and equals itie sum of PPs far 

that resource. 
15 YR1[1]*PR1[1]=4.5 = PPN1[1l + PPN2[1l/2 
YR1[2] * PR1[2] - 4.5 = PPN1P] + PPN2I2] /2 

Comparing the total resource revenue of the network for resource usage between 
stepl and step2 

Total Resource PriceRI R2[1J = PN1[1] + PN2[11 + PN3T/I1 * 4 units 
20 Total Resource PriceRI R2[2] = PN1[2] + PN2[2] + PN3J2] = 3 unite 

In total the resources fetches one unit less because there was spare capacity supply. 
3. Operator revenue: 

Due to the resource price adjustment mechanism that inyites more traffic, the total 

resource price of the network reduces, whUe the operator i» able to input more traffic 
25 into the network. 

Extra traffic permitted to input at no extra cost 

Extra traffic allowed at resoureeRI = YR1 [2] - YR1 [1 ] = 1 .5 units 

Extra traffic allowed at resourceR2 = YR2[2] - YR2[1J = 1-5 units 

If the user is paying a real price per unit share of resource (untt bandwidth in this case); 
30 the extra revenue to the operator from the user can be calculated as follows. CP here. 

means the real charged price. (For convenience of calculation, CP Is taken as the PP 

of individual users and remains same at both stepl and step2). 

Extra revenue from user « (CPN1[2) • UN1[2j + CPN2J2] * UN2[2] + CPN3[2] • UN3J2]) 

35 (CPN1[1]-UN1[1l + CPN2[irU^ 



25 



30 
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This revenue can then be utili^^ibyv#% pporaitoi- ^v^^^^^- 'iP^^^ <^ ^j; . 
individual users according to busiriess; strategy etc. - ^ m 

4.j£!messjp_userjra^^ .. ; • _ ._ _ t ; ^Xjlil 

5 It may be noted that each user trafftoilp^pays the samei re^purce.jfOTce^per resource- 

consumed: • VM*-- : -yj < \ii 

Resource price/ resource for userN1[2J * t?PN1[2] / UN1{2| = 0.76 r • |; 

Resource price/ resource for iiserfil2pg = (PPN2£21 /2^/ U*l2J2i^75 ; =. g 
Resource price/ resource for usenM3{2] = PPN3[2j / tteia^blTS ';>[ 
0 The property observed at step2 sujjfieals tr^ 

Users of each resource pay equal resource price per resource used. 

It will be noted that at step 10, a disturbance of two units is introduced to resource R1 
(disturbance signal is not plotted). The resource price of Ri can fee seen going! ftighs 
15 immediately. Flowl and Row2 reduces in a proportional manner no as to maintain Ihe 
total load at the set point, in other words, when the demand Is more than supply, the 
price is increased to force less usage. 

As a consequence of reduction in Flow2, the resource price of RI! goes down and lets 
20 in more traffic from Flow3. In other words, when the supply Is more than the demand; 
the price is reduced so as to force more usage. 



The interactions can be clearly seen In the graph. 

Thepricing function also drives flow levels to a proportionally fair clistribubon. 

After a while the disturbance is removed and the resource prices and hence me ftoyra ; 
regain the previous values. 

The gain factor determines the convergence. It is found that at low levels (say below 
0.16} ft is not very sensitive to osdllatfons arid te^ 

The system described above can be used to provide efficient uec: of availabte; network 
35 bandwidth, congestion control, providing class isolation and for increasing revenue. 
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Advantages to Carrier Nelwwk Opefajto^^ ... ' - . .;•:;•!_' 

A priori global knowledge of otherus^tr^ 

required. • ' .'••!;• 'i \ : -i'i. ; i hi 

5 Can be used in any system where : ^sspma^i^ "i^i^taF ; i^pA^tfj «sil«fe<na a#g^^^:^_ 
resources) operates as a virtual jjpc^^ 

available through OSPF, MPl^LSI^, .\ .; = ■'•;A\^:f 

. ■:■ ^|v:^::-: ?^ '"• i ■ vl-i ^-'.J.j^ 'J''' ! '.'; ■■\y^-}}Ak 

Ubiquitous deployment of the proposed ^ protocol is not required ^^^tp^^q 
10 This is obvious from the demonstration experiment, this facilitates incremental | 
deployment 

Available resource price information can directly be used 
Can assure Isolation among classes by keeping the allocated bandwidth 
15 Can readily integrate to charging systems 

Tries to fill up the network bandwidth to the allocated' control' level oT the class of traffic 
This increases the revenue to the operator 

Off-line models working on databases can be used as a nianagerrtent tool for impact; 
analysis etc 

20 These advantages can be readily examined from the numerical examples given earlier. ; 
Network utilisation is maximised 

Transport layer protocols (TCP. UDP etc) operate underneath the oxitrol provided 
TCP gets controlled at the ingress itself than at the core, thus enhances; the 
performance 

25 Users are treated in a proportional fair manner 

A further advantage of the arrangement is that the method .tray -.be irnplemented 
incrementally over a network to employ the controls described above for the system as 
a whole to operate effectively. However, the specific benefits of the present invention 
will have localised effect where it is not applied to the whole network. Greatest overall 

30 benefit is to be obtained when the method is applied throughout the network. 

Any range or device value given herein may be extended or altered without losing the 
effect sought, as will be apparent to the skilled person for an understanding of the ? 
teachings herein. 

Referring now to figure 7(a) there is shown a dynamic resource control system ; 
36 comprising a user (network) providing traffic into a network comprising edge node and 
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core routers. The user also provio^i^ Wffl &ftf< 




'" In: 



network, which is used in admission ©^ 
node. Feedback regarding resoM^ 
adjustment of the WtP parameter &r>t$rid^ frorn the inetswork twhetberiedge n^^pr . 
5 core routers) back to the origlnatirtg ufe r 

"the WtP parameter. ' j . •; 

In contrast in the arrangement of Figure 7(b) there is shown a second arrangement In 
which, instead of feeding back resource pricing infotjiteltej? to the user taffiatingijttie 

10 traffic, the feedback is provided to a Network Operator unit (NOWtF) which adjusts the 
WtP associated with the user's traffic The user has no direct control over thewtp 
parameter fed to the edge nodes, instead, the WtP parameter fed to the edge node is 
provided responsive to a service level agreement between the user and the network 
operator, together with any policies which the network operator allies in translating 

15 SLA's to WtP parameters. 

Figure 8 shows a development of this Idea. Three users 100-1, 100-2, 100-3 have date 
to send into a network 102. 

20 Each user has an associated willingness to pay parameter WtP1, WtP2 and WtP3. 
The willingness to pay parameter Is stored in respective service managers 104-1, 104- 
2, 104-3. 

As described above, the WtP may be agreed directly with the user or may be 
25 calculated by a network operator WtP calculator 106 which may have policies 108 
and/or service level agreements 110 as inputs. Taking these inputs, the network 
operator WtP calculator 106 is able to generate a willingness to pay value WtP3b, for 
user 3. 

30 The WtP parameter is used in conjunction with the price output «f the control loops 
described above (for example in connection with Figure 5) In order to adjust the volume 
of data accepted from each user using ingress (or edge router) control. Typically, this 
control loop would be concerned with monitoring QoS parameters os? the network, j 
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In this embodiment, a . secorKTcaw^;^^ 
resources such as bandwdfr ailoc^^ 



I 

r 



network (in terms of bandwidth) is fe^^y 3b : piovJ#$^^ 
is some inter-relationship between li*^^ 

relationship is managed by the sendee r^a^rs 104-1. 104-2, 10*3 which aro able to ; 
control resource allocation by adjiisflng,^ ^rayfaiipnwig pairaii»ejter PP1 , PP2, PrewHch 
is used as the "willingness to payf inp$ fc^ thssecond (lieltoork) control loop.; The; 
provisioning parameters are recced by heWrark managers 112-1. 1t2-2< 112^3^0^ 
are each associated with a particular user and service manager. 

With reference to Figure 9, the service control loops and network control loops 
described above are similar in structure to the loop described above in connection with ; 
Figure 1. 

15 With particular reference to Figure 9a. it will be seen that the QoS price output of the 
QoS control loop is fed to the service manager. One such control loop is provided for 
each QoS parameter which is to be controlled to a set point, thus, a particular user 
(with reference to Figure 10) such as user 2, who wishes to haze a service which 
provides a particular level of QoS parameter 1 and QoS parameter 2, has the QpS 

20 prices summed (in summer 114). This Is analogous to the bandwidth control loop 
described above in which a user wishing to use a plurality of routes between a plurality 
of paths between routers has the price for each path summed. Thus, a user wishing to 
have high QoS or control over a large number of QoS parameters '«!ll require a higher 
WtP value to obtain similar levels of each of those QoS relative to. as user which is only 

25 concerned with a small number of QoS parameters. 

Each user service manager 104-1. 104-2, 104-3 operates to dynamicaJry adjust the 
provisioning potential values so that the balance between bandwidth allocation and 
QoS can be met. By increasing the provisioning potential values led into the network 
30 control loop, the network control loop is caused to allocate more bandwidth to that user 
thereby facilitating an improvement in QoS. 

For example, if it is found that the convergence of the actual measured QoS 116 
(Figure 9a) with the set point QoS 118 Is very poor, then- one option for the service 
35 managers is to increase the provisioning potential value so that a particular user 
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receives a iarger allocation of barid^^ ^f^M^^ ^;^^^ 
measured at each router to corWe^i 40 the «t M«, 
managers and network managers penally negotiate 
. parameter in c^ to - er«*re .a^^^ 

Considering Figure 10 in detail, as disius^ above, user 2 has f^hed 'm ; 
which covers a requirement for particular levels perferrJiance in Wrms of Cto? ; 
parameter 1 and QoS parameter 2. Thus the prices a* symmed In 
before being fed into user 2 service manager 1044. The o*er users 100-1 and 100* 
have less complicated service levei agreement which mean that they are only 
interested in QoS parameter 1 and QoS parameter 2 resp*arvei* Thus each of their 
respective service managers is concerned only with the QoS price output from Moo?., 
of Figure 9a for each of the respective QoS parameters. 

in this example, user 2 is also wishing to send data over the network which uses a path; 
which requires the resources which are monitored by resource control toop 1 and 
control loop 2. Thus as discussed above in connection with Figuie 5. the price for th^ 
two resources is summed in summer 118 which is then used to provide an allocated 
resource share value by comparing the summed price wfth the provisioning potential,; 
Users 1 and 3 have data which flows only over a path using resou rce 1 and resource 2 
respectively. Thus their user network managers 112-1 and 112-3 are concerned only 
with the price output from the resource control toop (Figure 9b) for their respectrve 
resources. 
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It will be appreciated that the embodiment shown In Figure 10 is a very simple 
exemplary embodiment since it is concerned only with two possible QoS parameters, 
three users and only two network routers. In practice, this structure would be very 
much more complicated with many more users, resources and QoS measurements. » 
30 will also be appreciated that a user may for example operate only in the upper plane of 
the diagram having access to a QoS control toop but need not be concerned with the 
lower plane of the diagram in which resources are controlled using the type of control 
shown in Figure 1. 
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Similariy, a user may be conc^p^o^(|^»; ^ ! *?^!^*^?^!^ , ^^^^^|^ 



which case their respective nel „. 
in place of provisioning potential S^i^VW^ ^ atiallwtth tHe,**^; 

control loop. Thus a "mix and n^tch" approach may be taker, to in*femetita^^ 
5 .technique. . :• •. 

dearly, the full advantages of the telhSie will toe obtained wheii the whole netwbrkf 
has all users being provided with QoS and resource control loop operation. The -fn^ 
and match- approach is possible because it Is tieceaaary to have 

10 information about other users. Interaction between users occurs *>niy vto a pric*valu* ; 
The price value Itself is calculated by measurements at the router. Thus users may ; 
pass data through a router without having any interaction with th e dynamic resource 
control technique of this invention. In this case what happens is that this type! of user 
degrades QoS and user resources which this technique cannot control. However this ; 

15 degradation and use of resources is reflected by ^Mfcm**"^-*^^; 
in the control loops and is in turn reflected by a higher pricefor that QoS parameter or; 
bandwidth allocation. 



Thus it will be seen that the technique above provides a computationally simple and 
readily scaleaWe technique for providing particular QoS and also for balancing 
bandwidth " and fine control may therefore be had over QoS offered to users. 



This technique is applicable to any data network transport protocol, for example, UDP: 
or TCP/IP. It is also applicable to optical networks since it will be uppredated that if the 
25 resource control loop is operated very strictly to prevent network overload, buffering 
within the network Is not required. This is a consequence both of the fine control over, 
network utilisation and of the fact that control occurs at the ingress. 



